Faster Convex Optimization: Simulated Annealing with an Efficient Universal Barrier
نویسندگان
چکیده
Interior point methods and random walk approaches have been long considered disparate approaches for convex optimization. We show how simulated annealing, one of the most common random walk algorithms, is equivalent, in a certain sense, to the central path interior point algorithm applied to the entropic universal barrier function. Using this observation we improve the state of the art in polynomial time convex optimization. We give a randomized algorithm for optimization over a convex set, defined by a membership oracle, which improves the state of the art by at most square root of the dimension. This result is based on a new temperature schedule for simulated annealing, inspired by the relationship to the central path following interior point algorithm with the entropic universal barrier function.
منابع مشابه
Simulated Annealing for Convex Optimization
We apply the method known as simulated annealing to the following problem in convex optimization: minimize a linear function over an arbitrary convex set, where the convex set is specified only by a membership oracle. Using distributions from the Boltzmann-Gibbs family leads to an algorithm that needs only O∗( √ n) phases for instances in R. This gives an optimization algorithm that makes O∗(n4...
متن کاملA Stochastic Approach to the Weighted-Region Problem: Design and Testing of a Path Annealing Algorithm
This paper presents an efficient heuristic algorithm for planning near-optimal high-level paths for a point agent moving through complex terrain modeled by the Weighted-Region Problem. The input to the Weighted-Region Problem is a set of non-overlapping convex polygonal homogeneous-cost regions on a two-dimensional plane. Each region has an associated cost coefficient (or weight), for the cost ...
متن کاملAN EFFICIENT HYBRID ALGORITHM BASED ON PARTICLE SWARM AND SIMULATED ANNEALING FOR OPTIMAL DESIGN OF SPACE TRUSSES
In this paper, an efficient optimization algorithm is proposed based on Particle Swarm Optimization (PSO) and Simulated Annealing (SA) to optimize truss structures. The proposed algorithm utilizes the PSO for finding high fitness regions in the search space and the SA is used to perform further investigation in these regions. This strategy helps to use of information obtained by swarm in an opt...
متن کاملAn efficient implementation of the simulated annealing heuristic for the quadratic assignment problem
The quadratic assignment problem (QAP) is one of the most difficult combinatorial optimization problems. One of the most powerful and commonly used heuristics to obtain approximations to the optimal solution of the QAP is simulated annealing (SA). We present an efficient implementation of the SA heuristic which performs more than 100 times faster then existing implementations for large problem ...
متن کاملSolving Bus Terminal Location Problem Using Simulated Annealing Method
Bus network design is an important problem in public transportation. A main step to this design is determining the number of required terminals and their locations. This is a special type of facility location problem, which is a time-consuming, large scale, combinatorial problem. In a previous attempt by the authors, this problem had been solved by GAMS, based on a branch and bound algorithm.&...
متن کامل